Papers with gradient backpropagation
Autoregressive Entity Generation for End-to-End Task-Oriented Dialog (2022.coling-1)
Copied to clipboard
| Challenge: | Task-oriented dialog systems require external knowledge base to generate a response . current systems require scanning the KB at each turn, which is inefficient when the kb scales up . |
| Approach: | They propose to generate entity autoregressively before leveraging it to guide response generation. |
| Outcome: | Experiments on MultiWOZ 2.1 single and CAMREST show that the proposed system generates more high-quality and entity-consistent responses in an end-to-end manner. |
One-for-All Pruning: A Universal Model for Customized Compression of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing pruning methods for large language models (LLMs) focus on achieving high compression rates while maintaining model performance. |
| Approach: | They propose a Univeral Model for Customized Compression (UniCuCo) which introduces a StratNet that learns to map arbitrary requests to their optimal pruning strategy. |
| Outcome: | The proposed model is 28 times faster than baselines in processing 64 requests, while maintaining comparable accuracy to baselines. |